paul smith will take on andre ward on june 20 in california .
ward 's wba super-middleweight title will not be on the line .
smith is coming off back-to-back world title defeats by arthur abraham .
ward has not fought since he beat edwin rodriquez in november 2013 .